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ABSTRACT 

anded through the Ohio Disadvantaged Pupil Program 
Fund, the ColuiniDus Public Schools* Instructional Aide (lA) Program 
served 309 kinder jarten children ard 1,793 first-grade students 
during the 1983-89 school year. The goal of the lA program was to 
provid<^ an educational support program for underachieving pupils. 
Instructional aides were trained to providr direct instructional 
se'-vice to selected pupils in the classroom- The prograiP, which was 
implemented in 58 buildings and involved the equivalent of 135 aides 
assisting 199 teachers, emphasized activities which would increase 
oral languagp, written language, and reading skills. Program 
evaludtion efforts involved the administration cf sub-tests of the 
Comprehensive Tests of Basic Skills to kindergarten children ana 
first-grade students, and the use of locally constructed surveys of 
staff and reading assessments of students. The attendance criterion 
of 90 days was met by 154 kindergarten children and 1,136 
first-graders; of these, 903 pupils received pre- and post test 
administrations of the achievement test. Results for kinderga^'ten 
students indicated an average Normal Curve Equivalent (NCE) gain of 
2.2 per month for the 5.6 month project period, but less than 80% of 
the teachers perceived pupil progress was directly attrib^'table to 
the instructional aide. Results for first grade students indicated 
that students did not meet the goal of one NCE gain for each month of 
the program, although teacher ratings indicated that reading skills 
were substantially enhanced through direct instruction. (Twenty 
tables of data are included; survey forms and assessment instruments 
are appended.) (RS) 
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Ohio Disadvantaged Pupil Program Fund 

FINAL EVALUATION REPORT 
ADAPTATION OF CURRICULUM, INSTRUCTIONAL METHODS, AND MATERIALS COMPONENT 

INSTRUCTIONAL AIDE PROGRAM 
1988-89 

ABSTRACT 

Description; The Instructional Aide Program served 20i6 pupils In kindergarten 
and first grade. Funding of the program was made available through the Ohio 
Disadvantaged Pupil Program Fund of 1988-89. 

The goal of the Instructional Aide Program Is to provide an educational 
support program for underachieving pupils. The Instructional aides were 
trained to provide direct Instructional service to selected pupils In the 
classroom setting. Te&chers Involved with the program were assigned an aide 
for one-half day and provided direct supervision for the aide. The aides 
attended Inservlce training sessions and were provided with supplementary 
materials and many Instructional activities In the areas of oral language, 
written language, and reading skills. 

The Instructional Aide Program was located In 58 buildings with an 
equivalent of 135 aides serving 199 teachers. The average number of pupils 
served by an aide was 17.2 In kindergarten, and 20.3 In first grade. 

Time Interval: For evaluation purposes, the Instructional Aide Program started 
October 3, 1988 and continued through April 7, 1989. This Interval of time 
gave 112 days of program Instruction. Pupils Included In the final 
pretest-posttest analyslc must have attended at least 90 days (80%) during the 
tii2£; period stated above. 

Activities; Implementaclon of the program was accomplished through dally 
Instructional actlvltiep to strengthen and extend regular clasfroom 
Instruction. Emphasis was placed on activities which would Increase oral 
language, written language, and reading in order to enhance those skills needed 
to be successful in school. 

Program Objectives; Objective 1.1 (for kindergarten) and Objective 1.2 (for 
first grade pupils at or below the Reading Readiness stage) both stated that 
pupils who attended at least 80% of the program year would show an average gain 
of at least 1.0 NCE point for every month of instruction, as determined by a 
nationally standardized achievement test. Objective 2.0 stated tnat pupils 
would improve significantly in reading and language ^.rts , as perceived by their 
teachers. Objective 3.0 was to provide training sessions for participants 
regarding materials and skills necessary to perform the stated tasks of the 
instructional aides. The sessions would be perceived as meaningful and helpful 
by 80Z of the participants. 

Evaluation Design; The major evaluation effort was accomplished through the 
collection and analysis of the Oral Comprehension Test of the Comprehensive 
Tests of Basic Skills , Level A (CTBS;1981) for kindergarten. For first grade 
the Vocabulary, Word Recognition, and Reading Comprehension subtest of the 
Metropolitan Achievement Test , Form L (MAT6, 1987) were administered to 
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determine achievement gains for first grade pupils. Analyses of the data 
Included comparison between pretest and posttest scores In terms of raw scores, 
grude equivalents, percentiles and NCEs. Locally constructed surveys were used 
to obtain data from staff Involved In the program and the Student Assessment 
Form was completed by each first grade aide to ascertain the progress of target 
puplle In reading* 

Major Plndlnga/Recommendatlons; The :.aformatlon collected on the Pupil Census 
Form Indicated that 309 kindergarten pupils and 1793 first grade pupils were 
pretested and formed the basic group to be served by the project during the 
1988-89 school year* The average dally membership In the kindergarten 
component was 252*4* The average hours of Instruction per week was 2* 5. The 
average dally membership In the first grade component was 1528.8* The average 
hours of instruction per week was 2«8« 

The attendance criterion was met by 154 kindergarten pupils, or 49. 8Z of 
the 309 pupils served. Of these, 136 pupils received both administrations of 
the achievement test. The attendance criterion was met by 1136 first grade 
pupils, or 62#8Z of the 1793 pupils served. Of these, 767 pupils received both 
administrations of the achiever^ent test. 

A review of the kindergarten component indicated that (except for one 
criterion) the program objectives were achieved for the 1988-89 school year. 
There was evidence that all the criteria specified except Criterion 2.1 in the 
evaluation design were achieved. In particular, an analysis of the 
pretest-posttest achievement data for the 136 pupils in the evaluation sample 
showed an average NCE gain of 2.2 per month for the 5.6 month project period. 
Data indicated Criterion 2.1 called for evidence that 80Z of the teachers would 
perceive that pupils progress in reading and language arts would be directly 
attributable to the instructional aide. Overall, response indicated the 
criterion was not attained, but did indicate areas of success and those which 
should be considered in future program planning. 

A review of the data for the first grade component indicated that all the 
objectives of the program except one (Objective 1.2) were achieved for the 
1988-89 school year. Objective 1.2 called for an average gain of 1.0 NCE for 
each month of the program. Due to the inappropriateness of the pretest and 
posttest levels, the MAT6 results may not reflect true pupil performance for 
certain programs and groups of pupils and are therefore not being reported 
here. VRiile the level of achievement did not occur to the degree anticipated, 
teacher ratings would appear to indicate that the reading skills of target 
pupils were substantially enhanced through direct interactioi with the 
Instructional aide. In addition, an assessment of basal reading level growth 
showed that more than one-half of the pupils gained four or more basal levels. 

Considering the basic importance of reading skills to the educational 
process, as well as the major role that a lack of such skills play in 
inhibiting the progress of underachieving students, efforts to Improve the 
effectiveness of the whole language approach to reading instructioi should be 
encouraged. The present program, having demonstrated effect Iveness by 
improving the reading skills of underachieving pupils, should be continued. 
The training of aidej, however, should continue to be both int ;nsive and 
extensive with inservice training sessions provided early in the school year in 
order to strengthen instructional and motivational skills that would result In 
growth to reading comprehension, with emphasis on the whole language approach 
to instruction. A mid-year inservice to review skills for all aides vould help 
to enhance program continuity and encourage aides in their efforts t> fulfill 
program goals. The roles of the instructional team members need to be clearly 
defined with emphasis upon joint planning, communication, and cooperaticn* 

O 
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Ohio Disadvantaged Pupil Program Fund 

FINAL EVALUATION REPORT 
ADAPTATION OF CURRICULUM, INSTRUCTIONAL METHODS, AND MATERIALS COMPONENT 

INSTRUCTIONAL AIDE PROGRAM 

July 1989 



Program Description 

The goal of the Instructional Aide Program is to provide an educational 
support program for underachieving pupils. The instructional aides were trained 
to provide direct instructional service to selectea pupils in the classroom 
setting. Teachers involved with the program were assigned an aide tor one-half 
day and provided direct supervision for the aide. The aides attended inservice 
training sessions and were provided with supplementary materials and many 
instructional activities in the areas of oral language, written language, and 
reading skills. The ^idftf were also provided assistance whenever needed by two 
program coordinators whir" regularly visited the aides at their schools and 
prepared end presented some of the inservice programs to the aides. 

The Instructional Aide Program was located in 58 buildings with 135 aides 
aerving 199 teachers. The first grade aides program was located in 58 buildings 
with an equivalent of 88.5 aides serving 181 teachers. The kindergarten program 
was conducted in 10 buildings with an equivalent of 16 aides serving 18 
teachers. The buildings served by the program are listed below. 



Schools Served by the 
Instructional Aide Program 



Arlington Park 


Eakin 


Innis 


Pilgrim 


Avondale* 


East Columbus 


Kent 


Reeb 


Beck* 


Eastgate 


Koebel 


Salem 


Binns 


East Linden 


Lea wood 


Scioto Trail 


Broadleigh 


Fair 


Lincoln Park* 


Second* 


Burroughs 


Fairmoor 


Linden 


Siebert 


Cassady 


Fifth 


Livingston* 


South Mifflin 


Cedar wood 


Franklinton 


McGuffey 


Southwood 


Clarfield 


Georgian Hts. 


Main* 


Stockbridge 


Clinton 


Hamilton 


Maize 


Sullivant* 


Como 


Heyl 


Medary 


Trevitt* 


Cranbrook 


Highland 


Moler 


Weinland Park* 


Dana* 


Hubbard 


North Linden 


West Broad 


Deshler 


Hudson 


Ohio 


Westgate 
West Mound 
Windsor 



Schools with both kindergarten and first grade aides 
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Evaluation Objectives 

The follo%rlng objectives provided direction for the program comporjnts: 

Objective 1.0 Given the opportunity to participate for at least 80% of the 
measured period of instruction, kindergarten pupils will snow an average 
gain in reading of l.O normal curve equivalent (NCE) point for every month 
in the program as determined by a nationally standardized reading 
achievement test. 

Objective l.i Given the opportunity to participate for at least 80% of the 
measured period of instruction, first grade pupils identified as being at 
the reading readiness stage of development or below in September 1988 and 
selected for the program will show an average gain in reading of 1.0 NCE 
point for every month in tne program as determined by a nationally 
standardized reading achievement test. 

Objective 2.0 Given service of an instructional aide in the classroom, 80% 
of the teachers will perceive that pupils receiving instructional 
assistance by the aide improved significantly in reading and language arts 
as a direct result of that service. 

Criterion 2.1 Evidence of pupil improvement in reading and 

language arts as a result of the services of 
the aides as adjudged by the classroom teachers. 

Objective 3.L To provide meaningful training sessions for partici- 
pants regarding materials and skills necessary to perform the stated 
tasks of the instructional aides. 

Criterion 3.1 Evidence that 80% of the participants perceived 

each training session to be meaningful. 

Criterion 3.2 Evidence that 80% of the participants perceived 

the content of the training sessions as helpful 
in the classroom setting. 

Pupils were observed in September 1988 and were selected for service. The 
treatment period for evaluation purposes was 112 days, from October 3, 1988 to 
April 7, 1989. 

E valuation Design 

The evaluation design provided for the collection of data in five areas of 
program operation. Except for the standardized achievement tests, the 
instruments used to collect the data a^e found in the Appendix. 

1* Standardized Achievement Test Information 

The Oral Coir.prehension test of the Comprehensive Tests of Basic 
Skills , Level A (CTBS, 1981), was used to determine kindergarten pupil 
achievement gains. For grade one the Vocabulary, Word Recognition, and 
Reading Comprehension subtests of the Metropolitan Achievement Test, 
Form L (MAT6, 1985) were administered to determine first grade pupils 
achievement gains. In both kindergarten and grade one, the pretest was 
administered the week of September 26, 1988, and the posttest was ad- 
ministered the week of April 10, 1989. 
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2« Pupil Census Information 



A Pupil Census Form (locally constructed) was completed by program 
teachers and aides for each pupil served ( provide the following 
inforoatira: days of program enrollment, days of program attendance, and 
hours of instruction per week« Also asked were questions regarding the 
pupil's involvement in the Chapter 1 CLEAR program and if the pupil was 
non-English speaking* Collection of these forms was completed in April 
1989 (see p. 35, Appendix). 



3. Classroom Teacher Survey Information 



The Classroom Teacher Survey was completed by the teachers to whom 
aides were assigned. The purpose of the instrument was to obtain teachers' 
perceptions of: (a) inpact of the aides' services on the pupils' reading 
skills, and ^b) various aspects of the functioning of the program in the 
classroom. The locally developed survey was administered during May 1989« 
A copy of the Classroom Teacher Survey can be found on p. 31-32 and 36-37, 
Appendix A and B. 



4. Inservice Evaluation Information 



Sixteen inservice training sessions were provided for the instruc- 
tional aides throughout the school year. At the end of each session, the 
aides were askei to rate the value of the session by completing, the 
Instructional Aide Program Training Survey (p. 30). Finally, during early 
May 1989, the Instructional Assessment Instrument (pp. 33-34 and 38-39) was 
sent to all instructional aides in order chat they could assess the degree 
to which the content of the training sessions were adjudged to be of help 
in fulfilling their responsibilities in the classroom. Dates and topics of 
inservice meetings were as follows: 



Date Topic 

kug. 24, 1988 Pre-Service Conference 

Sept. 1, 1988 Child Growth and Development/Classroom 

Management 

Sept. 6, 1988 Special Conference at the Hyatt Regency 

Sept. 8, 1988 Introduction to Resource Guide-Concepts 

about Print 

Sept. 13, 1988 Manuscript 

Sept. 15, 1988 Manuscript Practice 

Sept^ 20, 1988 Early Reading Strategies 

Sept. 22. 1988 Writing/Lesson Plan Development and 

Effective Record Keeping 

Sept. 27, 1988 Children's Literature 

Sept. 29, 1988 Basal Reading Program, T./^vels 1-6 

Oct. 4, 1988 Storytelling 

Oct. 6, 1988 Teaching Early Reading Strategies 

Oct. 11, 1988 Reading Recovery Program Techniques 

Nov. 8, 1988 Desonstration of Good Teaching Strategies 

Nov. 10, 1988 Deaonstration of Good Teachiiig Strategies 

Nov. 17, 1988 Desonsr ration of Good Teaching Strategies 
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5« Student Assessment Form 

A Student Assessment Form was completed by the program teaci.^r and 
aide for each selected first grade classroom served. The purpose of the 
Instrument was to obtain information regarding the reading progress of each 
pupil enrolled in May. The instrument provided a classroom list of prog-am 
pupils and provided a space for teachers to enter the following information 
for each pupil: reading series and/or program employed for instruction, 
fall and spring basal reading levels, grade promotion status, and Chapter 1 
service status. Collection jf theee forms was completed in May 1989 (see 
p.'40, Appendix B). 

Major Finding s 



1 



Kindergarten Component 

The Pupil Census Form data indicated that 309 pupils were served by the 
project during the 1988-89 school year. The average number of pupils served 
during the year by the 16 aides was 17.2. The average daily membership (ADM) 
in the kindergarten component was 252.4. The average hours of instruction per 
week w/»', ^.5. 

First priority for pupil selection was given to underachieving pupils not 
served by Chapter 1 All Day Kindergarten (ADK). Second priority for selection 
was at the option of the classr Dm teacher to include underachlevers who were 
also being served in Chapter 1 ADK. Of the 309 pupils who were served by the 
program, 110 (35. 6Z) wera also served in Chapter 1 ADK. 

The information collected on the Pupil Census Form is summarized in Table 

1. The number of pupils fulfilling the requirement of attending 80% (90) of 
the project days was 154 (49. 8Z) out of a total of 309 pupils served by the 
project. The pretest-posttest analysis included 136 pupils out of the 15A 
pupils who took both the pretest and th? posttest and met the 80% attendance 
criterion. 

The results of the analysis of pretest-posttest achievement data fo- raw 
score minimums, maximums, averages, and standard deviations are shown In Table 

2. The achievement test used was the Oral Comprehension Test of The 
Comprehensl e Tests of Basic Skills (CTBS, 1981), Level A. The achievement 
data in Table 2 indicate that the average change in raw score from the pretest 
to the posttest was 3.0 items for the 136 pupils who took both the pretest and 
posttest. 

The results of the analysis of pretest-posttest achievement data for 
percentile minimums, maximums, medians and standard deviations are shown in 
Table 3. The median percentile for the pretest was 17.5, while the median 
percentile for the posttest was 36. 



ERJC EVALSRVCS/P518/RPTPAID89 



Table 1 

Number of Pupils Served, Averages for Days of Enrollment, Days of Attendance, 
Daily Membership and Hours of Instruction Per Week, and 
Pupils Attending 80% of Days 
Reported by Grade Level 
1988-89 





Pupils 
Served 










Average 




Pupils 


Grade 


GirlE 


Boys 


Days of 
Enrollment 


Days of 
Attendance 


Daily 

Membership 


Hrs. of Inst. 
Per Pupil Per Week 


Attending 
80% of Days 


K 


309 


143 


166 


91.5 


78.1 


252.4 


2.5 


154 



Table 2 

Minimum, Maximum, Average, and Standard Deviation 
of the Pretest and Post test Raw Scores 
Reported by Grade Level 
1988-89 





Number 


Number 
of Pupilp 






Pretest 








Posttest 






Grade 


of Test 
Items 


Min. 


Max. 


Average 
Correct 


Standard 
Deviation 


Min. 


Max. 


Average 
Correct 


Standard 
Deviation 


Average 
Change 


K 


15 


136 


2 


14 


7.7 


2.2 


3 


15 


10.7 


2.4 


3.0 
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The presentation of achievement data thus far includes results from the 
analysis of raw scores and percentiles. Raw scores are equal units of 
measurement but can only provide a limited interpretation of achievement data. 
Percentiles provide comparative information but are not equal units of 
measure. Caution is advised in drawing conclusions about program impact from 
any of the scores above. Normal curve equivalents (NCEs) are generally 
considered to provide the truest indication of student growth in achievement, 
since they provide comparative information in equal units of measurement. 

Data for NCEs are presented in Table 4. The results of the analysis of the 
pretest-posttest achievement data for the 136 pupils meeting the 80% attendance 
criterion and who ook both the pretest and posttest indicated an average 
growth of 12.3 NCEs or 2.2 NCEs per month for the 5.6 month period. Objective 
1.0 was therefore achieved for the kindergarten component of the Instructional 
Aid? Program. 

Table 5 contains data related to changes in NCE scores for three ranges: 
(a) no improvement in NCE scores (0.0 or less), (b) some improvement in NCE 
scores (0.1 to 6.9), and (c) substantial improvement in NCE scores (7.0 or 
more). iTie data indicate that 102 (75. OZ) pupils made gains in NCE scores. 
More specifically, 85 (62. 5Z) made substantial improvement and 17 (12. 5Z) made 
some improvement in NCE scores, and 34 (25. OZ) made no improvement. 

In May the teachers participating in the program were surveyed to evaluate 
their perceptions of the impact of the services of the aides on kindergarten 
pupils' reading readiness skills. Of the 18 teachers surveyed, 13 (72. 2Z) 
returned the survey. The first part of the survey asked the teachers to 
respond to eight statements concerning the performance of the instructional 
aide as well as the adequacy of the CTBS testing instrument. The second part 
of the survey asked the teachers to respond to 11 statements concerning the 
degree of progress by target pupils which could be attributed to the efforts of 
the instructional aide. The third part of the survey asked teachers to 
indicate the number of pupils retained, the number that might have been 
retained were it not for the services of the instructional aide, and the number 
of non-target group pupils retained. The teachers responded fo the items in 
Part 1 and 2 using a 5-'point rating scale of (1) Strongly Disagree, (2) 
Disagree, (3) Undecided, (4) Agree, and (5) Strongly Agree. Tables 6, 7, and 8 
contain a summary of responses to the three parts of the survey (see p. 31-32, 
Appendix A). 

The data indicated 9 (69. 3Z) of the teachers were in agreement with item 1 
(Table 6) regarding the degree of pupil success being attributable to the 
instructional aide, with 70. 9Z of the teachers agreeing to the aides overall 
level of performance contributing to pupils progress. Teacher ratings were 
generally below the 80Z criterion stated in the objective and is a clear 
indication that Criterion 2.1 specified in Objective 2.0 was not attained. 
While the criterion was not achieved, as indicated by teacher ratings, 
normative data indicated pupil's achievement did occur as anticipated. 

Of the 13 teachers responding to item 6, 8 indicated that the CTBS was not 
an accurate measure of reading readiness; the other teachers ^-^^re unsure (3) or 
agreed (2) with the accuracy of the measure. Response to items 5 and 7 
indicated that during readiness activities aides related well to pupils and 
that test instructions were adequate. 
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Table 3 

Minimum, Maximum, Median, and Standard Deviation 
of the Pret63t and Posttest Percentiles 
Reported by Grade Level 
1988-89 









Pretest 


Posttest 


Grade 


Number of 
Pupils 


Min 


Median Standard 
Max. Pe centile Deviation Min. 


Median Standard 
Max. Percentile Deviation 


K 


136 


3 


89 17.5 18.9 1 


96 36 27.1 


Table 4 

Minimum, Maxi-^um, Average, and Standard Deviation of the 
Pretest and Posttest Normal Curve Equivalents (NCE) 
Reported by Grade Level 
1988-89 








^ etest 


Posttest 


Grade 


Number 
of Pupils 


Min 


Average Standard 
Max. NCE Deviation Min. Max. 


Average Standard Average 
NCE Deviation Change 


K 


136 


12 


75 3K4 13.9 1 88 


43.6 19.1 12.3 
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Table 5 

Changes in Normal Curve Equivalents (NCE) Scores 
for Kindergarten Pupils 
1988-89 





Pupils 


No Improvement 


Some Improvement 


Substantial Improvement 




in Sample 


(0.0 or less) 


(0.1 to 6.9) 


(7.0 or more) 


Number of Pupils 


136 


34 


17 


85 


X of Pupils 




25. OZ 


12. 5Z 


62. 5Z 



14 
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Table 6 

Average Response and Percent of Responses ro 
Pari 1 of Che Classroom 
Teacher Survey (Kindergarten) 



Percent 



Item 



1. The overall readiness to 
read of pupils in the tar- 
get group has Improved 
significantly as a direct 
result of interacting with 
the instructional aide. 



Number Average SD D U 

Responding Response (1) (2) (3) 



A 

(4) 



13 



2. The Instructional materials 
made by the aide were use- 
ful in working with children. 13 

3. The instructional aide has 
a ba6j.^ understanding of 
how kindergarten pup -.Is be- 
gin to read. 13 



3.6 



3.9 



3.8 



15.4 



7.7 



15.4 



7.7 



7.7 



0.0 



7.7 38.5 



SA 
(5) 



30.8 



7.7 38.5 38.5 



7.7 46.2 30.8 



4. The Resource Guide and Hand - 
book developed for the pro- 
gram has been of great value 
to the aide in helping pupils. 13 



5. During readiness activities, 
the instructional aide re- 
lates well to the pupils. 



12 



6. The CTBS test instrument 
seemed to be an accurate 
measure of reading readiness. 13 

7. The instructions given to 
complete the CTBS testing 
process were adequate. 13 

8. The time alloted for test- 
ing was adequate. 13 



3,6 



4.2 



2.6 



4.1 



3.9 



0.0 



8.3 



0.0 



0.0 



7.7 



0.0 



7.7 53.8 



0.0 



7.7 



23.1 69.2 



8.3 33.3 



23.1 



7.7 



0.0 



50.0 



7.7 



7.7 76.9 15 4 



7.7 69.2 15.4 



Note. Ratings were based on the following scale: 
SD - Strongly Disagree 
D ■ Disagree 
U - Undecided 
A " Agree 

SA ■ Strongly Agree 
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Overall, 72.5% of the ratings by teachers attributed pupil progress to the 
instructional aide as indicated by the ratings of the 11 skill areas which are 
Hated in Table 7. The average rating was 3.1 (3 is Undecided and 4 
Agreenent )• 

The teachers agreed that f»idea made a significant contribution to pupils in 
3 of the U areas surveyed. Twelve teachers (92. 3X) indicated that aides did 
help pupils to progress in writing letters of the alphabet, their name, and 
numbers; ten (83«3Z) perceived aides to help pupils recognize basal words from 
the Ginn series* The ratings indicated the revised Resource Guide and Handbook 
was not valued to the degree expected. It should be noted that the first grade 
handbook was revised but not the one for kindergarten. The revised first grade 
Resource Guide and Handbook was utilized for instructional purposes in the 
joint kindergarten/first grade training sessions periodically throughout the 
year and on occasion referred to in the kindergarten-specific inservice 
meetings* The use of the handbook was based on the assumption that information 
shared, regarding the whole language approach to instruction, was applicable to 
all in attendance* Process data indicated aides did not pf>rceive the content 
of the training sessions to be as helpful in the kindergarten classroom as 
expected* 

Teacher responses to part three of the survey, Table 8, indicated that only 
two target pupils were retained this year; a total of 11 additional pupils 
mig'it have been retained were it not for the services of the instructional 
aides, and one non-target pupil was retained as judged by those teachers 
responding* The data indicated that an average of 1*3 pupils per teacher were 
probably promoted and were not retained as a result of having additional 
instructional support by each instructional aide* 

The data indicate that Criterion 2*1 specified in Objective 2*0 was not 
achieved* Teacher ratings were not as positive as had been anticipated and 
would appear to suggest several areas of concern for future consideration in 
program planning: the adequacy of the CTBS as an accurate measure of reading 
readiness was of great concern* 

During the year, a series of 16 inservice sessions was provided for the 
kindergarten and first grade instructional aides* At the end of each session, 
the aides were asked to rate the value of the session by completing the 
Instructional Aide Program Training Survey (see p* 3C, Appendix A)* The 
overall evaluation of the content presented at the session is summarized in 
Table 9* The evidence shows that the aides perceived the inservice sessions to 
be very informative, interesting, and worthwhile* Thus, Criterion 3*1 was 
achieved* 

In May 1988, the Instructional Assessment Instrument was sent to the 
kindergarten instructional aides* The purpose of this instrument was to assess 
the value of the inservice after the aides had an opportunity to apply the 
inservice training and materials in the classroom* The aides were asked to 
respond to 13 statements by circling (1) Strongly Disagree, (2) Disagree, (3) 
Undecided, '>) Agree, and (5) Strongly Agree (see p* 33-34, Appendix A)* Of 
the 18 aides, 14 (77*8Z) returned the survey* Table 10 contains the findings* 
The evidence outlined in Table 10 shows that Criterion 3*2 was attained* 
Overall, there was a 80*7% positive response of the 13 statements regarding the 
value of inservice listed in Table 10* While aides' ratings were as positive 
as anticipated, they did appear to highlight areas of concern for future 
consideration in program planning (i*e*, the perceived helpfulness of inservice 
training sessions for kindergarten aides and the utilization of the Resource 
Guide and Handbook)* 
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Table 7 

Average Response and Percent of Responses to 
Pare 2 of Che Classroom 

Teacher Survey (Kindergarten) 



Item 



Number Average 
Responding Response 



Percent 



SD 

HI 



D U 
(2) (3) 



A SA 
(4) (5) 



1. Relate and share 
experiences and 
stories In correct 
sequence 

2. Write the letters of the 
al phabet 

3. Write their names and 
numbers (1-20) 

4. Deliver oral messages 
correctly 

5. Listen and respond to 
stories, poems, plays 
and other literary forms 

6. Recall details, stories 

7. Differentiate lltces, 
similarities, shapes, 
sizes, facts and 
fantasies 

8« Know the sounds of 
single consonants 

9. Match words to pictures 

10. Understand the main 
Idea 

11. Recognize basal words from 
the Glnn reading series 



13 
13 
13 
13 

13 

13 



13 

13 
13 

13 

12 



3.5 
4.1 
4.2 
3.5 

3.8 
3.7 



3.8 

3.5 
3.5 

3.5 

4.2 



7.7 15.4 15.4 



7.7 



7.7 



15.4 
7.7 



7.7 

7.7 
7.7 

7.7 

8.3 



0.0 



0.0 



7.7 15.4 



0.0 
7.7 



7.7 

15.4 
7.7 



0.0 
0.0 
7.7 

7.7 
7.7 



0.0 

7.7 
23.1 



7.7 30.8 



38.5 23.1 



61.5 30.8 



46.2 46.2 



53.8 15.4 



46.2 
61.5 



53.8 
46.2 



30.8 
15.4 



61.5 23.1 



15.4 
15.4 



0.0 



8.3 



38.5 15.4 



33.3 50.0 



Note. Racings were based on the following scale; 
SD - SCrongly Disagree 

D ■ Disagree 

U - Undecided 

A - Agree 
SA - SCrongly Agree 



<3 
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Table 8 

Average Response and Percent of Responses to 
Part 3 of the Classroom 
Teacher Survey (Kindergarten) 



Item 



Number 
of 

Teachers 



Number 

of 
Pupils 



!• How many iri»tructional 
aide program target 
pupils are you retaining 
this year because of 
reading deficiences? 



13 



Average 
Number 
of Students 



0.2 



3. 



How many additional 
instructional aide 
program target pupils 
might you have retained , 
because of reading 
deficiencies y were it 
not for the services of 
the instructional aide? 

How many non-target 
group pupils are you 
retaining this year? 



13 



13 



11 



0.8 



0.1 



Table 9 

Instructional Aides' Responses Relating to the 
Sixteen Inservice Sessions 



Content Presented Was N Percent 



a. Very Informative 670 85.2 
Informative 114 14,5 
Not Informative 2 0.3 

b. Very Interesting 613 79.2 
Interesting 155 20.0 
Not Very Interesting 6 0.8 

c. Very Worthwhile 646 83.7 
Worthwhile 123 15,0 
Not Worthwhile 3 0.4 
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Table 10 

Average Response and Percent of Responses 
for Part 1 of the Instructional Assessment 
Instrument (Kindergarten) 



Percent 



Item 



Number Average SD D U A SA 
Responding Response (1) (2) (3) (4) (5) 



1. As a result of the Inservlce 
training sessions, I have a 
greater underatandlng of how 
kindergarteners get ready 

to read. 14 

2. The Inservlce training sessions 
have helped me to effectively 
participate In the reading 
readiness activities which are 
conducted In a kindergarten 
classroom. 14 

3. As a result of the Inservlce 
training sessions, I have a 
better understanding of the 
concerns and responsibilities 
that a kindergarten teacher 
has toward the beginning 
Instruction of reading. 14 

4. The topics presented In the 
Inservlce training sessions 
were helpful to me In under- 
standing my job In the class- 
room. 14 

5. I understand how the Glnn 
reading series Is to be used 

at the kindergarten level. 14 

6. During the Inservlce training 
sessions, I learned many 
activities and Instructional 
methods which may be used In 
the Instruction of reading with 
kindergarten pupils* 14 

7* These Inservlce sessions have 

made me aware of the Instructional 

resources made available by 

our school system. 14 



4.3 7.1 0.0 0.0 42.9 50.0 



4.1 7.1 7.1 0.0 42.9 42.9 



4.2 7.1 7.1 0.0 28.6 57.1 



3.7 7.1 21.4 0.0 35.7 35.7 



4.4 0.0 7.1 0.0 42.9 50.0 



3.6 0.0 28.6 0 0 50.0 21.4 



4.1 0.0 7.1 0.0 64.3 28.6 



Note. Ratings were based on the following scale: 
SD ■ Strongly Disagree 

D ■ Disagree 

U - Undecided 

A ■ Agree 
SA - Strongly Agree 
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Table 10 (Continued) 



Percent 



Item 



Number Average SD 
Responding Response (1) 



D U A SA 

(2) (3) (4) (5) 



8. After the Inservlce training 
sessions, I felt prepared to 
assist children In learning to 

read. 14 

9. I shared Information from the 
Inservlce training sessions 
with the kindergarten teacher(s) 

to whom I am assigned. 14 

10. The teacher(s) I work with has 
shared Ideas and shown me ways 
to become better at helping 

pupils learn to read. 13 

11. I used the Resource Guide 
Handbook on at least a weekly 

basis. 14 

12. The Resource Guide and handbook 
was very useful to me In the 
Instruction of reading and 

language arts skills* 14 

13. Overall, the Resource Guide 
and Handbook was very adequate 

In helping me do my job. 14 



3.9 



4.6 



4.6 



3.3 



3.7 



3.5 



7.1 



0.0 



0.0 



7.1 



7.1 



7.1 



7.1 0.0 57.1 28.6 



7.1 0.0 2:. 4 71.4 



0.0 7.7 23.1 69.2 



21.4 14.3 50.0 7.1 



0.0 21.4 57.1 14.3 



7.1 28.6 42.9 14.3 



Note. Ratings were based on the following scale: 
SD - Strongly Disagree 

D " Disagree 

U - Undecided 

A - Agree 
SA - Strongly Agree 



First Grade Component 

The Pupil Census Form data Indicated that 1793 first-grade pupils were 
served by the project during the 1988-89 school year. The average number of 
pupils served during the year by the 88.5 aides was 20.3. The average daily 
membership (ADM) In the first grade component was 1528.8. The average hours of 
Instruction per week was 2.8. 
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First priority for pupil selection was given to underachieving pupils not 
served by Chapter 1 CLEAR, Second priority for selection was at the option of 
the classroom teacher to Include underachlevers who were also being served In 
Chapter 1 CLEAR» Of the 1793 pupils who were served by the program, 499 
(27.8Z) were also serv^^sd In Chapter 1 CLEAR, The Information collected on the 
Pupil Census Form is summarized In Table 11 • Out of a total of 1793 pupils 
served by the project, 1136 (63. 4Z) met the attendance criterion by attending 
80% (90) of 112 project days. The pretest-posttest analysis Included 767 
pupils of the 1136 pupils who took both a pretest and posttest and meet the 80Z 
attendance criterion. 

First grade pupils were administered the Vocabulary, Word Recognition, and 
Reading Comprehension subtest of the Metropolitan Achievement Test> Form L 
(KATb^ 1985) In the Fall and In the Spring, Due to the Inapproprlateness of 
the pretest and posttest levels, the MAT6 results may not reflect true pupil 
performance for certain programs and groups of pupils. Data are presented here 
for purpose of making them available to the reader, however, no Interpretations 
are being made. Results of analyses are presented in Tables 11. 12. 13. and 
14, 

In May, the teachers p^^rtJ jlpatlng in the program were surveyed to evaluate 
their perceptions of the impact of the services of the aides on first grade 
pupils' reading skills. Of the 181 teachers, 115 (63,5%) returned the 
survey^ The first part of the survey asked the teachers to respond to eight 
statements concerning the performance of the instructional aide as well as the 
adequacy of the test instrument administered. The second part of the survey 
asked the teachers to respond to 11 statements concerning the degree of 
progress by target pupils which could be attributed to the efforts of the 
instructional aide. The third part of the survey asked teachers to indicate 
the number of pupils retained, the number that might have been retained this 
year because of reading deficiencies were it not for the services of the 
instructional aide, and the number of non-target group pupils retained. The 
teachers responded to the items in Part 1 and 2 by using a 5-polnt rating scale 
of (1) Strongly Disagree, (2) Disagree, (3) Undecided, (4) Agree, and (5) 
Strongly Agree (see p. 36-37, Appendix B), Tables 15, 16, and 17 contain a 
summary of responses to the three parts of the survey. The teachers' agreement 
with item 1 is an indication that Criterion 2,1 specified in Objective 2,0 was 
achieved. While the criterion was achieved, as indicated by teacher ratings, 
normative data indicate pupil achievement did not occur as anticipated. 

Of the teachers responding to item 6, 44, 8Z (48) indicated that the JIAT6 
Test was an accurate measure of pupil achievement; 18, 7^ (20) teachers were 
undecided and 36,4% (39) perceived the test was not an accurate measure. It 
should b noted the MAT6 was selected for use during the 1988-89 school year at 
the request of the Division of Elementary Schools, At the time it was 
considered to be the best test which matched the districts Course of Study for 
first grade. The test was previously utilized by the Reading Recovery Program 
and consequently perceived to be appropriate and worthy of use for all first 
grade testing in the system. Responses to item 7 indicated that test 
Instructions were adequate. Responses to item 8 indicated that most teachers 
felt f lat the time allotted for testing was adequate. 

Overall, 85,8% of the teachers attributed pupil progress to the 
instructional aide as indicated by positive ratings of the 11 skill areas which 
are listed in Table 16, The .average rating was 4,1 (3 is Undecided and 4 
Agreement) , 



EVALSRVCS/P518/RPTFAID89 



22 



Table 11 

Number of Pupils Served, Averages for Days of Enrollment, Days of Attendance, 
Daily Membership and Hours of Instruction Per Week, and 
Pupils Attending 80Z of Days 
Reported by Grade Level 
1988-89 



Average Pupils 

P^P^ls Days of Days of Daily Hrs. of Inst. Attending 

Grade Served Girls Bo_ys Enrollment Attendance Membership Per Pupil Per Week 80Z of Days 

1 1793 763 1030 Q5.5 85. ^ 1528.8 2.8 1136 



Table 12 

Minimum, Maximum, Median, and Standard Deviation 
of the Pretest and Posttest Percentiles 
Reported by Grade Level 
1988-89 











Pretest 








Posttest 




Grade 


Nur/uer of 
Pupils 


Min, 


Max. 


Median 
Percentile 


Standard 
Deviation 


Min. 


Max. 


Median 
Percentile 


Standard 
Deviation 


1 


767 


lA 


80 


39 


8.4 


26 


89 


67 


13.4 
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Mlnlmumi Maximum, Average, . Standaro Deviation of the 
Pretest and ?csttest Normal Curve Equivalents (NCE) 
Reported by Jrade Level 



Number 
Grade of Pupils 


Pretest 




t'osttest 






Average 
Min. Max. NCE 


Standard 

Deviation Min. 


Average 
Max. NCE 


Standard 
Deviat ion 


Average 
Chanff e 


1 767 


1.0 81.1 29.6 


9.1 1.0 


99.0 28.7 


21.7 


-0.8 




Table 14 

Changes in Normal Curve Equivalents (NCE) Scores 
for First Grade Pupils 
1988-89 








Pupils No Improvement 
in Sample (0.0 or less) 


Some Improvement 
(0.1 to 6.9) 


Substantial Improvement 
(7.0 or more) 




Number of Pupils 
X of Pupils 


439 

767 57.2% 


81 

10.6" 


247 
32.2% 







2'6 
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Table 15 

Average Response and Percent of Responses for 
Part 1 of the Classroom 
Teacher Survey (F^rst Grade) 



Item 



Percent 



Number Average SD D U A SA 
Responding Response (1) (2) (3) (4) (5) 



1« The overall reading and 
language arts abilities of 
pupils in the target group 
improved significantly as 
a result of interacting 
with the instructional 
aide* 109 

2. The instructional 

materials made by the aide 

were useful in working 

with children* 109 

3* The instructional aide has 
a basic understanding of 
how beginning reading and 
language arts are tauglit. 109 

4. The Resource Guide and 

Handbook developed for the 
program has been of great 
value to the instruc- 
tional aide in helping 
pupils • 107 

5* During reading and 

language arts activities, 

the instructional aide 

relates well to the 

pupils* 109 

6. The MAT6 test instrument 
seemed to be an adequate 
measure of pupil achieve- 
ment, 107 

7. The instructions given to 
complete the MAT6 testing 
process were adequate* 109 

8. The time allotted for 

testing was adequate* 109 



4.2 



4,3 



4.2 



3.9 



4.4 



2.8 6.4 2.8 46.8 41.3 



2.8 2.8 3.7 40.4 50.5 



4.6 6.4 0.9 41.3 46.8 



2.8 5.6 17.8 41.1 32.7 



1.8 3.7 6.4 31.2 56*9 



3.0 14.0 22.4 18.7 38.3 6.5 

4.1 0.0 5.5 5.5 66.1 22.9 
3*9 1*8 4^6 5.5 69.7 18.3 



Note. Ratings were based on the following scale: 
SD - Strongly Disagree 
D ■ Disagree 
U - Undecided 
A - Agree 

SA - Strongly Agree ^ 

o ^ ^ 27 

EKJC ;VALSRVCS/P518/RPTPAID89 



19 



Table 16 

Average Response and Percent of Responses for 
Part 2 of the Classroom 
Teacher Sur^ ey (First Grade) 



Items 



Number 
Responding 



Average 
Response 



Percent 



SD D U A SA 
(1) (2) (3) (4) (5) 



2. 



Relate and share ex- 
periences and stories In 
correct sequence 

Recognize lower and upper 
case alphabet letters. 



3. Write numerals correctly 
4. 



5. 



Form and space letters 
and words correctly 

Use manuscript to write 
words and sentences 



6. Match words with pictures 

7. Recognize that v-^rds may 
name people » places , 
animals, and tMngs 

8. Recognize that words may 
be grouped to express 

a complete thought 

9. Read certain groups of 
sentences accurately 

10. Listen and respond to stories, 
poems, plays, and other lit- 
erary forms 

11. Recognize basal words from the 
Ginn reading series 



113 

115 
114 

1 1 k 

114 
114 

114 

114 
113 

113 
113 



4.0 

4.3 
3.9 

4.0 

4.0 
4.2 

4.1 

4.2 
4.2 

4.3 
4.2 



2.7 9.7 3.5 52.2 31.9 

2.6 6.1 2.6 33.0 55.7 

4.4 9.6 9.6 41.2 35.1 

3.5 8.8 5.3 47.4 35.1 

3.5 7.9 7.9 44.7 36.0 

2.6 3.5 6. 1 /:3.0 44.7 

3.5 4.4 7.0 45.6 39.5 



3.5 



Note. Ratings were based on the following scale: 
SD - Strongly Disagree 
D - Disagree 
U - Undecided 
A ■ Agree 
SA - Strongly Agree 



3.5 4,4 50.9 37.7 



2.7 6.2 1.8 43.4 46.0 



0.9 5.3 4.4 42.5 46.9 



1.8 3.5 3.5 51.3 39.8 
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Table 17 

Average Response and Percent of Responses to 
Part 3 of the Classroom 
Teacher Survey (First Grade) 







Number 


Number 






Item 


of 


of 


Average 




Teachers 


Pupils 


Response 


I. 


How many I ^structional Aide 










program pupils are you 










retaining this year because 










of reading deficiencies? 


115 


219 


1.9 


2. 


How many Instructional aide 










program target pupils might 










you have retained bec^^use of 










reading deficiencies, were 










It not for the services of 










the Instructional aide? 


115 


286 


2.5 


3. 


How many non-target group 










pupils are you retaining 










this year? 


115 


55 


0.5 
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.toclM lu corre« 8,qu.Qce. Of 11^ ""■■'■■8 experiences and 

aide. ,uo ..d. ^ , : , cltrib "'on h^7.^„';T n"*' ^"'^ 

word. fro. the Ginn serle.. "'IP'"! PuP"" Co recognize b...l 

great as anticipated. Teacher r«MnA i^ "^""^ progress was not as 

concern for future ':oa.uVre"o"1:''pr"orr 1 Zn" ng" ( 'f "irlrC n"" f 
correctly). Concern was also expressed regarding the adequacy of the MATfi 
as an accurate measure of reading achievement. ^ 

grade%'S'truc" aitJ^'^'r' ^""-^/-trument was sent to the first 
ADDcndlx B^!!- ? u purpose of this instrument (see p.38-39 

Appendix B) was to assess the value of the inservice after the h./ 

»U.gree. DU^ree. o/Zridel. ^ 'IJ"r"nd 'fs/'sOv'l^ ""t' 
la.tr„.enr we. returned by 94 (80.3Z) of 117Tlde^ "rveyed. ^ ' ^ 

Of c"^^e^l'grrC;^er^reTo^?r^ru"'4^^^^^^^^ ^-^e-i- 1"- 1 
:^e^*arrr^e\v^i'^;.'r^lc^l^^T'rtt°'V•"^^^^^^^^^^^ 

re.l.ed Resource <;..ld^'. J"";"!" '' «f the 

prog«.."f 'p"°U. the t'.f-M'""""' '"f"™'""" "««d.ng the reading 

^r^tp"on^t."f%v^rtet^r '""'4 """^^^^^^ 
ipJing'kdSS r eo^mru^tir f^ z 

series adopted by the distric't A e"' A "^''n.' ^^^'^^^^^^ the reading 

uui^ucu Dj cne aiscrlct (i.e., Ginn). Of this number lO'^fi (7R ir^ 

the program criteria for service and are included in these analyses/ llblL tg 
and 20 contain summaries of the results. aiyses. laoies 19 
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Table 18 

Average Response and Percent of Responses for 
Aides" Perceptions of the Training Sessions (First Grade) 



Item 



Number 
Responding 



Average 
Response 



Percent 



SD 
IIL 



D 

121 



U 
(3) 



A 
(A) 



SA 

(5) 



1« As a result of the" in- 
service training sessions, 
I have a greater under- 
standing of how first 
graders learn to read. 94 

2* The inservice training 
sessions have helped me to 
effectively participate in 
the reading and language 
arts activities which are 
conducted in a first grade 
classroom* 94 

3. As a result of the in- 
service training sessions, 

I have a greater understand- 
ing of the concerns and 
responsibilities that a 
first grade teacher has 
toward the instruction of 
reading, and language zrts. 94 

4. The topics presented in the 
inservice training sessions 
were necessary to help de- 
fine and support my role 

in the classroom. 93 

5. I understand how the 
Ginn reading series is 
to be used at the first 

grade level. 93 

6. During the Inservice train- 
ing sessions, I learned 
many activities and in- 
structional methods which 
may be used in the teaching 
of reading and language 
arts with first grade 

pupils. 93 



4.4 



0.0 0.0 



0.0 



57.4 



42.6 



4.4 



0.0 



1.1 



0.0 



60.6 



38.3 



4.4 



0.0 



2.1 



4.3 



50.0 



43.6 



4.4 



0.0 



0.0 



4.3 



55.9 



39.8 



4.3 



0.0 



0.0 



5.4 



61.3 



33.3 



4.4 



0.0 



1.1 



1.1 



55.9 



41.9 
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Table 18 (Continued) 



Percent 



Item 



Number 
Responding 



Average 
Response 



SD D U A SA 

(1) (2) (3) (4) (5) 



7. These Inservlce sessions 
have made me aware of 

the instructional resources 

made available by our 

school system. 93 

8. After the Inservlce training 
session » I felt prepared to 
help children develop and 
use reading and language 

arts skills. 94 

9. I shared Information from the 
Inservlce training sessions 
with the first grade 
teacher(s) to whom I am 
assigned. 94 

10. The teacher(s) I work with 
has shared Ideas and shown 
me ways to become better at 
helping pupils develop and 
use reading and language 

arts skills. 92 

11. I used the Resource Guide 
and Handbook on at least 

a weekly basis. 94 

12. The Resource Guide and 
Handbook was very useful 

to me In the Instruction of 
reading and language arts 
skills. 93 

13. Overall, the Resource Guide 
and Handbook was very adequate 

in helping me do my Job. 93 



4.3 



4.3 



4.3 



4.1 



4.1 



4.3 



4.5 



Note. Ratings were based on the following gcale: 
SD - Strongly Disagree 

D ■ Disagree 

U - Undecided 

A - Agree 
SA - Strongly Agree 



0.0 



0.0 



0.0 



1.1 



0.0 



0.0 



0.0 



1. 1 3.2 60.2 35.5 



0.0 0.0 67.0 33.0 



2.1 0.0 61.7 



36.2 



8.7 5.4 53.3 31.5 



5. 3 6.4 56.4 31.9 



1.1 4.3 53.8 40.9 



0.0 4.3 53.8 41.9 
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Table 19 presents the distribution of the reading level status of 1036 
pupils in the fall and 1034 in the spring. The data indicated that 1006 (97. 3Z) 
of the pupils progressed beyond the reading readiness level. The school system 
generally considers first grade pupils having completed the third preprimer as 
eligible for promotion. The data also indicated 416 (40. 2Z) of the pupils who 
read at the readiness level in the fall were still reading in one of the three 
preprimers in the spring. Those first grade pupils reading beyond the third 
preprimer level were considered to be reading closer to grade level and eligible 
for promotion to second grade. Of the 1034 pupils, 618 (59. 8Z) pupils were able 
to reach this level of attainment. 



Table 19 



Distribution of Fall and Spring Reading Levels 
for Program Eligible First Grade Pupils 
Using the District Adopted Reading Series 
1988-89 



Basal 
Reading Level 



Fall 



Spring 



Frequency Percent Frequency Percent 



Below Reading Readiness 
Reading Readiness 
Firpt Pre-priirer 
Second Pre-primer 
Third Pre-primer 
Beyond Third Pre-primer 



204 
832 



19.7 


11 


1.1 


80.3 


17 


1.6 




Al 


4.0 




76 


7.3 




271 


26.2 




618 


59.8 



In Table 20, the distribution of reading level growth is summarized. Of the 
1034 pupils in the analysis, 993 (96.02) showed growth of two or more reading 
levels, and 664 (64.22) showed growth of four or more reading levels. 
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Table 20 

Distribution of Reading Level Growth 
for Program Eligible First Grade Pupils 
Using the District Adopted Reading Series 



Categories of 

Reading Level Growth Frequency Percent 

- Level 3 o,3 

No Level 13 1^3 

One Level 25 2»4 

Two Levels 90 8»7 

Three Levels 239 23.1 

Four Levels 464 44«9 

Five Levels or More 200 19,3 



Summary/Recommendations 

Kindergarten Component 

The kindergarten component of the Instructional Aide Program provided an 
educational program for kindergarten pupils who were underachievers in reading. 
The program was conducted in 10 schools with an equivalent of 16 aides serving 
309 pupils and 18 teachers. The instructional aides attended 16 half-day 
inservice training sessions during the school year with emphasis on the whole 
language approach to instruction. 

A review of the data presented herein indicates that (except for one 
criterion) all program objectives were achieved for the 1988-89 school year. In 
particular, an analysis of the pretest-posttest achievement data for the 136 
pupils who met the 8GZ attendance criterion and who took both the pretest and 
posttest showed an average NCE gain of 2.2 per month for the 5.6 month project 
period, doubling the expected rate of growth. There is evidence which indicates 
that all the criteria specified in the evaluation design except Criterion 2.1 
wore achieved. Criterion 2.1 called for evidence that teac*^-*rs would perceive 
that target pupils improved significantly in reading and language arts as the 
result of receiving assistance from aides; teacher ratings in this regard were 
well below those made during the past five years and the lowest in the history 
of the program. 

Process evaluation indicated a few teachers were greatly dissatisfied with 
their project team arrangement and were highly desirous of a change. The survey 
highlighted areas of specific concern for future program consideration (i.e., 
the perceived adequacy of the CTBS as an accurate measure of reading, the degree 
of perceived pupil progress attributed to aides' instruction, and the use of the 
Resource Guide and Handbook ) . It should bt noted, the revised first grade 
Resource Guide and Handbook was utilized for instructional purposes in the joint 
kindergarten/ first grade training sessions periodically throughout the year. 
The use of the handbook was based Cii the assumption that information shared 
regarding the whole language approach to instruction was applicable to all in 
attendance. Some kindergarten-specific training sessions were provided. 
However, process data and survey responses indicated aides did not perceive the 
content of the training sessions to be as helpful in the kindergarten classroom 
as expected, i.e., equipping them with needed instructional activities, 
understandings, and methods to be used in language based instruction. 
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Considering the success of the present program In achieving the prescribed 
objectives for the 1988-89 school year, as well as the basic Importance of 
reading to the future academic success of pupils, the present program should be 
continued. The training of aides, however, should continue .0 be both intensive 
and extensive with inservice training sessions provided early in the school year 
to strengthen instructional skills. These sessions should be directed to the 
kindergarten level and should Incorporate sound developmental principals of 
learning, particularly in those areas highlighted In the Teacher Survey and the 
Aides Assessment. The roles of the instructional team members need to be 
clearly defined with emphasis upon joint planning, communication, and 
cooperation* 

First Grade Component 

The first grade component of the Instructional Aide Program continued to 
provide an educational program for first grade pupils who were underachlevers in 
reading. The program was conducted in 58 schools with the equivalent of 88.5 
aides serving 1793 pupils and 181 teachers. The instructional aides attended a 
series of 16 half-day inservice training sessions in the fall. These sessions 
focused on a number of topics which were designed to increase the effectiveness 
of each aide in the classroom with emphasis on the whole language approach to 
Instruction. 

A review of the data presented herein indicates that all the objectives of 
the program except one (Objective 1.2) were achieved for the 1988-89 school 
year. Objective 1.2 stated that pupils who attended at least 80Z of the program 
year would show an average gain of at least 1.0 NCE point for every month of 
Instruction, as determined by a nationally standardized achievement test. Due 
to the InappropriateneoS o2 the pretest and posttest levels, the MAT6 results 
nay not reflect true pupil performance for certain programs and groups of pupils 
and therefore are not reported here. While the level of achievement may not 
have occurred to the degree anticipated, teacher ratint^s would appear to 
indicate that the reading skills of target pupils were substantially enhanced 
through direct Interaction with the instructional aide. In addition, an 
assessment of basal reading level growth showed that more than 602 c^f the pupils 
gained four or more basal levels. The success of this program reaffirms that 
instructional aides with appropriate training and directed classroom service may 
be effectively employed by first-grade teachers to Improve reading skills of 
underachieving pupils > 

Considering the basic Importance of reading skills to the educational 
process, as well as the major role that a lack of such skills play in inhibiting 
the progress of underachieving pupils, efforts to Improve the effectiveness of 
reading instruction should be encouraged. The present program, having 
demonstrated effectiveness by improving the basal reading level growth of 
underachieving pupils, should be continued. '^e training of aides, however, 
should continue to be both intensive and extensive with inservice training 
sessions provided early in the school year in order to strengthen instructional 
and motivational skills that would result in growth in reading comprehension, 
with emphasis on the whole language approach to instruction. A mid-year 
inservice to review skills for all aides would help to enhance program 
continuity and encourage aides in their efforts to fulfill program goals. The 
roles of the instructional team members need to be clearly defined with emphasis 
upon joint planning, communication, and cooperation. 
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Evaluation data and information obtained through the evaluation process 
suggested that the success of the program could be increased if action was taken 
on the folloviog items* 

1* Efforts should be made to select a more appropriate test found to be 
effective for use at grade one, with strong consideration being given to 
the type of pupils who meet program criterion, 

2. When and where possible, the project evaluator and coordinators should 
increase project- classroom visitation to ascertain the degree of program 
implementation ind to answer questions regarding the program and its 
evaluation. These visits would provide valuable feedback regarding the 
status of program goalii , objectives , implementation of instructional 
activities, and evaluation procedures. 

3. From visitation and discussion with project personnel, there were 
probably more pupils served during the 1988-89 school year than what the 
data indicate* Collection of data has improved over the years, but 
there is still a need for more accurate accounting. When and where 
possible, the project evaluator should be provided the opportunity, as 
needed, to reacquaint aides with appropriate evaluation procedures at 
the close of inservice meetings. More input would enhance the 
collection of dr.mographic data on pupils served and encourage the 
documentation of records for each pupil served regardless of service 
duration* 

4. Provide teachers and the -ildes with a clear understanding of their roles 
and responsibilities in regards to instructional objectives and program 
goals the should be worked toward in the classroom, especially in the 
areas of ^roving reading comprehension as appropriate at both grade 
levels, with emphasis upon the whole language approach to instruction. 
Where possible, clarify the function of the classroom teacher and aide 
as members of the instructional team. 

5. Provide an inservice program to broaden the base of instructional skills 
as reflected in the survey results (i*e*, effective utilization of the 
Resource Guide and Handbook ) , reinforce communication skills acquired 
and enhance classroom planning* The improvement of reading 
comprehension as related to the whole language approach to instruction 
should be a major focus of the inservice program as appropriate at both 
grade levels, with a lid-year Inservice for all aides to encourage and 
enhance program continuity* 

6* Measures should continue to be taken to insure the stability of a 
trained instructional aide staff* While the turnover rate of 
instructional aides has been reduced, there is still a need to provide 
ti'ained aides for positions vacated throughout the school year* 
Maintaining trained am' only retaining competent aides would enhance 
program achievement and continuity* 
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Columbus Public Schools 
DrPF Instructional Aide Program 

PREOPENING CONFERE.VCE EVALUATION FORM 
August 24, 1988 



Please check ( / ) one in each column: 

Years of Experience 

Compcnent i„ Xnst . Aide Prog* 

Principal 

^ dgn. Teacher (1st Year) 

Ist Grade Instruc. A.-'de (2nd Year) 

Other (specify) Other (specify) (3rd Year) 



More 



Instructions: Answer the question below by putting a check ( ) in the space that best shows 
your opinion. 

1. The content prese : teddy's session was: 

a* very informative 
informative 

not informative ^^^^ 

b« very interesting 

inter, ting " 

not very interesting .^^^ 

c^ very worthwhile 
wortawhlle 

not worthwhile 

2. Was the length of the session ad€ ^uate for presentation of the subject area(s)? 

Yes No Explain 



3« Was there sufficient opportunity f )r questions and answers? 
Yes No Explain^ 



4. Were questions answered? Yes No Explain 



5* What' changes do you suggest for improving today's session? 



6. What aubjec" areas do you recommend for futu.'e sessions? 
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Date: 



Please check (>/) one: Please check ( 



one: 



Component : 



Kdg. 



Subject Area(s)_ 
Presenter (s) 



(month, da/, year) Principal 

Teacher 

1st Grade Instructional 

Aide 



Years of Experience 
in the Inst* Aide 
Program 

(1st Year) 

(2nd Year) 

^(3rd Year) 

(More) 



Instructions: Answer the question below by putting a check (v/) in the space that best shows 
your opinion* 

1* The content presented at today's session was: 

a* very informative 

informative — 
not informative 

b* v«ry interesting 

interesting 

not very interesting 

c» very worthwhile 

worthwhile ^ 

not worthwhile 

2. Was the length of the session adequate for presentation of the subject area? 
Yes No Explain 



3. Was there sufficient opportunity for questions and answers? 

Yes No Explain 

Were questions answered? Yes No Explain 



4. What changes do you suggest for improving today's session? 



5. What subject are,:s do you recommend for future sessions? 
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Columbus Public Schools 
Inctructlonal Aide Program (Kindergarten) 
1988-89 



CLASSROOM TEACHER SURVEY 

The Classroom Teacher Survey of the Instructional Aide Program is designed 
to evaluate your perceptions of the overall aide program. Please complete the 
following survey and return it by school sail no later than May 12. 1989# 
Thank you* — — ^-j— 



Part I. Listed below are statements regarding the Instructional Aide Program. 

Please circle the one response that best describes your feelings about 
each statement. Responses are (SA) Strongly Agree, (A) Agreement, (U) 
are Undecided, (D) Disagree or (SD) Strongly DiP«gree. 



1. The overall readiness to read of 
pupils in the target group has 
improved significantly as a 
direct result of interacting with 
the instructional aide. 



SA 



SD 



The instructional materials 
made by the aide were useful 
in working with children. 



SA 



SD 



The instructional aide has a 
basic understanding of how 
kindergarten pupils begin to 
read. 



SA 



SD 



The Resource Guide and Handbook 
developed for the program has 
beer of great value to the aide 
in helping pupils. 



SA 



SD 



5. During readiness activities, the 
instructional aide relates wtll 
to the pupils. 



SA 



SD 



The CTBS instrument seomed 
to be an adequate measure 
of reading readiness. 



SA A U D SD 



The instructions given to 
complete the CTBS testing 
process were adequate. 



SA A U D SD 



8. The time alloted for testing 
was adequate. 



SA A TI D SD 
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Part 2. Please Indicate the degree to ^hich progress was experienced by target 
group pupils in reading and language arts which can be attributed to 
the efforts of the instructional aide. Please circle the one response 
that best describes your feelings about each statement. Responses are 
(SA) Strongly Agree, (A) Agree, (U) are Undecided, (D) Disagree or 
(SD) Strongly Disagree. 

As the result of the efforts of the instructional aide, target 
group pupils are better able to: 

!• Relate and share experiences SA A U D SD 

and stories in correct sequence 

2. Write the letters of the alphabet SA A U D SD 

3. Write their names and numbers (1-20) SA A U D SD 

4. r :iiver oral messages correctly SA A U D SD 

5. Listen and respond to st .ies, SA A U D SD 
poems, plays and other literary 

forms 

6. Recall details and stories SA A U D SD 

7. Differentiate likes, similaricies , SA A U D SD 
shapes, sizes, facts and 

fantasies 



8. Know the sounds of single SA 
consonants 



SD 



9. Match words to pictures SA A U D SD 

10. Understand the main idea SA A U D SD 

IK Recognize basal words from the SA A U D SD 

Ginn reading series 

Part 3. Listed below are questions regarding the impact of the instructional 
aide on the progress of target pupils. Please indicate your response 
by recording the appropriate number. 

1. How many inscruct ional aide program target pupils are you 

retaining this year because of reading deficiencies?^ 



2. How many additional instructional aide program target pupils 
might you have retained , because of reading deficiencies, were It 
not for the services of the Instructional aida? 

3. How many non-target group pupils are you retaining this 
year? 
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Columbus Public Schools 
Instructional Aide Program (Kindergarten) 
1988-89 



INSTRUCTIONAL AIDE ASSESSMENT INSTRUMENT 

The Instructional Aide Assessment of the Kindergarten Instructional Aide 
Program is designed to evaluate your perceptions of this program, please 
complete the following assessment and return it by school mail no later than 
May 12, 1989> Thank you. 

Part 1. Please respond to the following statements by circling one response 
which best indicates whether you (SA) Strongly Agree, (A) Agree, (U) 
are Undecided, (D) Disagree, or (SD) Strongly Disagree with each 
statement* 



1* As a rerilt of the inservice training 
sessions, I have a greater under- 
standing of how kindergarteners get 
ready to read* SA 

2* The inservice trai^iing sessions helped 
me to effectively participate in 
the reading readiness activities 
which are conducted in a kinder- 
garten classroom* SA 

3c As a result of the inservice training 
sessions, I have a better under* 
standing of the concerns and 
responsibilities that a kindergarten 
teacher has toward the beginning 
instruction of reading* sA 

4* The topics presented in the inservice 
training sessions were helpful to me 
in understanding my job in the 
classroom* SA 

3* I understand how the Ginn reading 
series is to be used at the kinder- 
garten level* SA 

6* During the inservice training sessions, 
I learned many activities and in- 
structional methods which may be used 
in the instruction of reading with 
kindergarten pupils* SA 



U D 



U D 



U 



SD 



SD 



SD 



D SD 



SD 



U D 



SD 



ERLC 



7* These inservice sessions made 
me aware of the instructional 
resources made available by our 
school system* 

8* After the inservice training 

session, I felt prepared ♦•o help 
children in learning to i^ad* 
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SA 



SA 



U D 



U D 



SD 



SD 
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9. I shared information from the in- 
service training sessions with the 
kindergarten teacher(s) to whcm I 

am assigned* SA A U D SD 

10* The teacher(8) I work with has shared 
ideas and shown me ways to become 
bett#r at helping pupils learn to 

read. SA A U D SD 

11. I used the Resource Guide and Handbook 

on at least a weekly basis. SA A U D SD 

12*» The Resource Guide and Handbook is very 
useful to me in the instruction of 

reading and language arts skills. SA A U D SD 

13. Overall, the Resource Guide and 
Handbook was very adequate in 

helping me do my job. sA A U D SD 



Part 2. As required by the Department of Education, for the State of Ohio, 
please indicate below the average number of sessions you work with 
target students per week ; the average number of students , where 
appropriate, and number of minutes per session. A session is defined 
as a block of time in which you provide direct service to 
target pupils, individually or in a small group. The calculation 
of the average number of sessions and average number of minutes 
pupils are served is based upon a typical week in v*^^ instruc- 
tion was provided by the categories listed below. 



AVERAGE 

Number c ' Number of Number of 

Sessions Students Minutes 

Per Week Per Session Per Session 

1. Individualized 
Instruction 

a. Writing Skills N/A 

b. Reading N/A 



2. Small Group 
Instruction 

a. Writing Skills 



b. Reading 



44 



1 

Appendix B 
Firsc Grade Component 



IC 

^ EVALSRVCS/P518/RPTFAI089 



45 



TEACHER 
NUMBER 
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PROGRAM 

CODE 



! 



STUDENT 



SCHOOL 



GRAOi 



SEX 
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MALE 

o 

FEMALE 
O 



TOTAL 
DAYS 
OF 
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ENROLL 
MENT 

1 2 3 
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COLUMBUS PUBLIC SCHOOLS - Columbus. Ohio PUPIL CENSUS FORM 



LAST NAME 



FIRST NAME 



TEACHER NUMtER 



SCHOOL 



GRADE 



USE A NUMBER 2 .»ENCIL. ERASE COMPLETELY WHEN MAKING CORRECTIOIMS. 
11 1. MAS THIS A NON^ENSLna SPEAKIN6 STim FNTT fSEE MOWK 



3 



YES NO 
•* * 

ooooooooooooooooooocooooooooooooooooo 

L 2. WAS TH;S pupil !=FRVED by a CMAPTEW I PROfiMM? • I 

YES NO 
* * 

l ooooooooooooooooooooooooooooooooooo oo 
. ooooooooooooooooooooooooooooooooooooQ 

I' 1 

^ OOOOOOOOOOOOOOOOOOOOOOGOOOOOOOOOOOOOQ^ 

ooQooooooooooooooooooooooooooooo o o o o o 



QOOOOOOOOQQOOOOOOOOOOOOOOOGOOQQ Q O O O C O 

— Z ^ZZD 



_ o ooo oo oooooooooooooooooooooooo ooooo o o 

il ' -_l 
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CO 
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Columbus Public Schools 
Instructional Aide Program (First Grade) 
1988-89 



CLASSROOM TEACHER SURVEY 



The ClassrooM Teacher Survey of the lastructlonal Aide Program Is designed 
to evaluate your perceptions of the overall aide program. Please complete the 
following survey and return It by school mall no later than May 12, 1989, 
Thank you. — ^— ^ 



Part 1, 



Listed below are statements regarding the Instructional Aide Program. 
Please circle the one response that best describes your feelings about 
each statement. Responses are (SA) Strongly Agree, (A) Agree, (U) are 
Undecided, (D) Disagree or (SD) Strongly Disagree. 



1. The overall reading and I'^'^guage arts 
abilities of pupils In the target 
group Improved significantly as a 
result of interacting with the 
instructional aides. 



SA 



U 



SD 



2. The instructional macerlals 
made by the aide were useful 
in working with children. 



SA A U D SD 



3. The instructional aide has a 
basic understanding of how 
beginning reading and language 
arts are taught. 

4. The Resource Guide and Handbook 
developed for the program has 
been of great value to the 
instr'jctional aide in helping 
pupils. 



SA A U D SD 



SA A U D SD 



5. During reading and language arts SA 
activities, the instructional aide 
relates well to the pupils. 

6. The MAT6 instrument seemed Co be SA 
an adequate measure of pupil 
achievement . 



SD 



SD 



7. The instructions given to coaplete 
the MAT6 testing process w«re 
adequate. 



SA 



SD 



8. The time alloted for testing 
was adequate. 



SA 



SD 
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Part 2. Please indicate the degree to which progress was experie.iced by target 
group pupils in reading and language arts which can be attributed to 
the efforts of the instructional aide_» Please circle the one response 
Chat best describes your feelings about each statement. Responses are 
(SA) Strongly Agree, (A) Agree, (U) are Undecided, (D) Disagree or 
(SD) Strongly Disagree* 

As the result of the efforts of the instructional aide, target 
group pupils are better aole to: 

1* Relate and share experiences SA A U D SD 

and stories in correct sequence 

2* Recognize lower and upper case 

alphabet letters SA A U D SD 

3» Write numerals correctly SA A U D SD 

4« Form and space letters and 

words correctly SA A U D SD 

5* Use manuscript to write words 

and sentences SA A n D SD 

6» Match words with pictures SA A U D SD 

7, Recognize that words may name 
people, places, animals, and 

things SA A U D SD 

8* Recognize that words may be grouped 

to express a complete thought SA A U D SD 

9* Read certain groups of words 

or sentences accurately SA A U D SD 

10« Listen and respond to stories, 
poems, plays, and other literary 

forms SA A U D SD 

11* Recognize basal words from the Ginn 

reading series SA A U D SD 

Part 3. Listed below are questions regarding the impact of the instructional 
aide on the progress of target pupils. Please indicate your response 
by recording the appropriate number* 

1. How many instructional aide program target pupils are you 
retaining this year because of reading deficiencies? 



£• How many additional instructional aide program target pupils might 
you have retained , because of reading deficiencies, were it not 
for the services of the instructional aide?^ 

3* How many non-target group pupils are you retaining this 
year? 
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Columbus Public Schools 
Instructional Aide Prog* ^ (First Grade) 
1988-8 



INSTRUCTIONAL AIDE ASSESSMENT INSTRUMENT 

The Instmctioaal Aide Assessment of the First Grade Instructional Aide 
Prograa is designed to evaluate your perceptions of this program. Please 
complete the following assessment and return it by school mail no later than 
May 12. 1989* Thank you> 

Part 1* Please respond to the following statements by circling one response 
which best indicates whether you (SA) Strongly Agree, (A) Agree, (U) 
are Undecided, (D) Disagree or (SD) Strongly Disagree with each 
statement* 

!• As a result of the inservice training 
sessions, I have a greater under- 
standing of ^ow first graders learn 

to resd. SA A U D SD 

2* The inservice training sessions have 
helped me to effectively participate 
in the reading and language arts 
activities which are conducted in 

a first grade classroom* SA A U D SD 

3. As a result of the inservice training 
sessions, I have a greater understanding 
of the concerns and responsibilities 
that a first grade teacher has toward 
the instruction of reading and 

language arts. SA A U D SD 

4. The topics presented in the inservice 
training sessions were necessary to 
help define and support my role in 

the classroom. SA A U D SD 

5. I understand how the Ginn reading 
series la to be used at the first 

grade level. SA A U D SD 

6. During the inservice training sessions, 
I learned many activities and in- 
structional methods which may be used 
in the teaching of reading and language 

arts with first grade pupils. SA A U D SD 

7. These inservice sessions have 
made me aware of the instruc- 
tional resources made available 

by our schoo^ system. SA A U D SD 
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8* After the inservice training session, 
I felt prepared to help children 
develop and use reading and language 

arts skills* SA A U D SD 

9* I shared information from the inservice 
training sessions with the first grade 

teacher(s) to whom I am assigned* SA A U D SD 

10* The teacher(8) I work with has shared 
ideas and shown me ways to become 
better at helping pupils develop and 

use reading and language arts skills. SA A U D SD 

11. 1 used the Resource Guide and Handbook 

on at least a weekly basis* SA A U D SD 

12* The Resource Guide and Handbook was 
very useful to me in the instruction 

of reading and language arts skills. SA A U D SD 

13* Overall, the Resource Guide and 
was very adequate in helping 

me do my job. SA A U D SD 

Part 2. As required by the Department of Education, for the State of Ohio, 
please indicate below the average number of sessions you work with 
target students per week ; the average number of students , where 
appropriate, and number of minutes per session* A session is defined 
as a block of time in which you provide direct service to 
target pupils, inuividually or in a small group* The calculation 
of the average number of sessions and average number of minutes 
pupils are served is based upon a typical week in which instruction 
was provided by the categories listed below* 



AVERAGE 



Number of Number of Numbei of 

Sessions Students Minutes 
Per Week Per Session Per Session 



1* Individualized 
Instruction 

a* Writing Skills N/A 

b* Reading N/A 

2* Small Group 
Instruction 

a* Writing Skills 

b* Reading 
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